EXISTENCE AND REGULARITY 
OF STRICT CRITICAL SUBSOLUTIONS 
IN THE STATIONARY ERGODIC SETTING 



ANDREA DAVINI AND ANTONIO SICONOLFI 

Abstract. We prove that any continuous and convex stationary ergodic Hamil- 
tonian admits critical subsolutions, which are strict outside the random Aubry 
set. They make up, in addition, a dense subset of aU critical subsolutions with 
respect to a suitable metric. If the Hamiltonian is additionally assumed of Tonelli 
type, then there exist strict subsolutions of class C^'^ in R^. The proofs are 
based on the use of Lax-Oleinik semigroups and their regularizing properties in 
the stationary ergodic environment, as well as on a generalized notion of Aubry 
set. 



1. Introduction 

Throughout the paper we deal with a Hamiltonian H{x,p,Lo) defined in x 
X 17, where Q is a probability space which is separable, in a suitable measure- 
theoretic sense. It is assumed that acts ergodically on Q and that H satisfies a 
stationarity property with respect to such action. As well known, this frame, usually 
called stationary ergodic, generalizes periodic, quasi-periodic and almost-periodic 
settings. Besides the basic convexity and growth conditions in p, we require H to 
be continuous in x in Section [3l and of Tonelli type in Section SI 

The main object of our investigation is the stochastic Hamilton-Jacobi equation 
corresponding to the critical value of H, say c, which is in principle a random variable 
but stays almost surely constant, due to the ergodicity hypothesis. It is characterized 
by the fact that the critical equation H = c has admissible subsolutions, but H = a 
does not at any subcritical level, i.e. whenever a < c. By admissible subsolution 
we mean a random Lipschitz function that has stationary increments, sublinear 
growth at infinity, and the property of being an almost everywhere subsolution in 
M.^ , almost surely with respect to lo. By convexity of the Hamiltonian, this last 
condition is equivalent to the notion of viscosity subsolution. 

It is well known that the critical value is the unique level for which the correspond- 
ing Hamilton-Jacobi equation may have viscosity solutions, also termed correctors 
for the role they play in associated homogenization problems. The issue of finding 
characterizing conditions for the existence of correctors has been addressed in [lO^lllj 
by means of a stochastic version of weak KAM Theory and of an adaptation of the 
metric techniques developed for deterministic Hamilton-Jacobi equations. The cor- 
nerstone of this approach is a random notion of Aubry set, defined following the 
basic idea that the real invariant objects to look at in the analysis of stationary er- 
godic equations are not any more single points of the state space but instead random 
closed stationary sets. It has been characterized in the aforementioned references 
as the minimal closed stationary random set for which there exists an admissible 
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subsolution strict in its complement, at least in a weak sense, see Section 13.11 for 
precise definitions and results. 

The present paper fits into the same line of research. It specifically aims at 
generalizing the previous characterization result in two directions. On one side one 
would like to get admissible subsolutions strict outside the random Aubry set, but 
in a stronger more classical sense; on the other, assuming the Hamiltonian to be 
Tonelli, to show that such random functions can be taken almost surely of class 
C^'^ in the whole of M.^ . This is actually achieved by making use of the associated 
positive and negative Lax-Oleinik semigroups, which seems new in this context, and 
shows the effectiveness of these tools in the stationary ergodic setting, opening the 
door to a fruitful use of it for the study of other topics in the field, as well. 

The sought generalizations can be, in particular, regarded as a step forward to 
deduce comparison principles for the critical equation. In the periodic case, for 
instance, similar results permit to show that the Aubry set is a uniqueness set for 
the critical equation, meaning that two admissible solutions agreeing on it are in 
fact the same. Here, as usual, the problem gets more involved since it is not still 
clear how to exploit the weak form of compactness encoded in the stationary ergodic 
model. 

The connection between regularity of subsolutions and the property of being strict 
in some distinguished regions can be understood if we think of finding regular sub- 
solutions of the Hamilton-Jacobi equation at a supercritical level. In this case, 
the problem becomes relatively easy and does not require any special theory to be 
developed since, roughly speaking, there is some space to make a direct regulariza- 
tion starting from any globally strict subsolution, for example through mollification, 
without violating the subsolution property. When instead no strict subsolutions are 
available to start with, the problem becomes difficult and requires a deeper under- 
standing of the setup. 

To give account of the main results on the subject in the deterministic case, we 
recall that an initial crucial step has been to realize that the obstruction in getting 
strict subsolution for critical equations is not spread out indistinctly on the whole 
ambient space, but is concentrated around a specific set named after Aubry. Using 
this information, the existence of critical subsolutions have been first proved in 
|17| for Hamiltonians Lipschitz-continuous in the state variable through a technique 
combining partitions of unity and coverings, which non surprisingly requires quite 
laborious estimates in proximity of the Aubry set. 

Next, a relevant progress has been made in 0] where C^'^ subsolutions, which is 
the optimal attainable regularity, have been found, at least when the Hamiltonian 
is Tonelli and the ambient space compact, through a simpler a more powerful pro- 
cedure based on a double alternate application of positive and negative Lax-Oleinik 
semigroup. Within this approach, the difficulty of dealing with the Aubry set is 
bypassed thanks to the fact that the action of such semigroups do not affect critical 
subsolutions on the Aubry set. A nontrivial extension of this result to noncom- 
pact setting has been more recently provided in [16j by means of countable many 
alternative applications of Lax-Oleinik semigroups. 

To further illustrate our results avoiding technical complications, we assume in the 
remainder of the Introduction the critical value to be , which is not restrictive up 
to adding a constant to the Hamiltonian. Our main achievements are the following: 
first, we provide a construction of the random Aubry set that simplifies the one given 
in [To] and that allows us to get rid of a restrictive condition therein assumed (see 
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(|A|) in Section [3TT]) . still keeping the crucial property of existence of an admissible 
critical subsolution, weakly strict outside it. The crucial improvement with respect 
to the analysis performed in [10] being that the main tools used here are Lax-Oleinik 
semigroups instead of the critical semidistance. 

Secondly, as already pointed out, we in addition establish the existence of admis- 
sible critical subsolutions that are strict, in the usual and stronger sense, outside 
the random Aubry set. More precisely, we show that any given weakly strict critical 
subsolution can be approximated, with respect to the L°° norm in M^, by a critical 
subsolution that is strict outside the random Aubry set, see Theorem 13. 161 The key 
point here is the discovery of the fact that the negative Lax-Oleinik semigroup, when 
acting on a weakly strict subsolution, produces a 1-parameter family of admissible 
critical subsolutions that is strictly increasing outside the random Aubry set, see 
Proposition 13.191 In the end, the sought strict subsolution is defined, as usual in 
the topic, through infinite convex combination of the critical subsolutions obtained 
by applying the negative Lax-Oleinik semigroup to the initial weakly strict one at 
suitably small times, see Theorem 13.161 Via a standard argument, is then easy to 
prove that strict critical subsolutions are dense, with respect to a suitable metric, 
among all critical admissible ones. 

When the Hamiltonian is additionally assumed of Tonelli type, such strict critical 
subsolutions can be taken of class C^'^ in M^. This is obtained by first deducing a 
further invariance of Lax-Oleinik semigroups with respect to strict critical subsolu- 
tions, and then by applying to the stationary ergodic environment the regularizing 
procedure due to Bernard, see [4]. The lack of compactness of the ground space does 
not affect the method since, under our assumptions, we have a global control on 
of the semiconcavity or semiconvexity constants of the subsolutions generated in the 
construction. See Remark 14.41 for more comments on this issue. 

The paper is divided in three sections. Section [2] has introductory character: we 
give notation, terminology and we recall some basic mathematical facts that will be 
used throughout the paper. Further we provide a brief presentation of the stationary 
ergodic setting and of the corresponding stochastic Hamilton- J acobi equations, and 
present the salient properties of the positive and negative Lax-Oleinik semigroups 
in random environments. Section 3 is about continuous Hamiltonians. In the first 
subsection we give the definition of random Aubry set and we prove the existence 
of an admissible critical subsolution that is weakly strict outside it. In the second 
subsection we strengthen these results by showing existence and density of strict 
critical subsolutions. The final section is devoted to Hamiltonians of Tonelli type. 
In the first subsection we list some additional properties enjoyed by the Lax-Oleinik 
semigroups and by the random Aubry set in our setting, while in the second one 
we present and apply Bernard's method to the case at issue and we derive the 
announced results about regular strict subsolutions. 
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2. Basic material 



2.1. Notations and preliminaries. We write below a list of symbols used through- 
out this paper. 

an integer number 
Br{xo) the closed ball in centered at xq of radius R 
Bji the closed ball in centered at of radius R 
( • , • ) the scalar product in 
I ■ I the Euclidean norm in 

M+ the set of nonnegative real numbers 
S(M^) the (T-algebra of Borel subsets of 
Xe the characteristic function of the set E 

Given a subset U of M^, we denote by U its closure. We furthermore say that 
U is compactly contained in a subset V of if U is compact and contained in V. 
If is a Lebesgue measurable subset of M^, we denote by \E\ its A^-dimensional 
Lebesgue measure, and qualify E as negligible whenever \E\ = 0. We say that a 
property holds almost everywhere (a.e. for short) on M.^ if it holds up to a negligible 
set. Given a function u defined in M.^ , we will write u € C^'^{Br{xQ)) to mean that 
u is of class C^'^ on Br{xo). We will denote by Lip(u; Br{xo)) and Lip{Du; Br{xQ)) 
the Lipschitz constant of u and Du in Br{xo), respectively. 

With the term curve we will refer to an absolutely continuous function from some 
given interval [a, 6] to M^. 

A function il) is said to be supertangent (resp. subtangent) to a continuous 
function it at a point xq if iP{xq) = u{xo) and ip > u { resp. ip < u) locally around 
xq. The (possibly empty) set made up by the differentials of supertangents (resp. 
subtangents) at xq is called superdifferential (resp. sub differential) and denoted by 
D~^u{xq) (resp. D~u{xq)). We recall that if both super and sub differential are 
nonempty then u is differentiable at xq. 

Given a locally Lipschitz function u in an open subset U of M^, we will denote 
by d*u{xo) the set of reachable gradients of u at xq, that is the set 

d*u{xo) = {lim Du{xn) '■ u is differentiable at Xn, Xn xq }, 

n 

while the Clarke's generalized gradient d^u{xQ) is the closed convex hull of d*u{xQ). 
The set 3^u(xo) contains both D~^u{xo) and D~u{xo), in particular Du{xq) G 
d^u{xo) at any differentiability point xq of u. We recall that the set- valued map 
X d'^u{x) is upper semicontinuous with respect to set inclusion. When d'^u{xo) 
reduces to a singleton, the function u is said to be strictly differentiable at that 
point. In this instance, u is differentiable at xq and its gradient is continuous at xq. 
When u depends on a time and space variable, indicated by t and x, respectively, 
we will denote by d'j;u{x,t) the Clarke's generalized gradient of the function u{-,x) 
at t, and by d^u{x,t) the Clarke's generalized gradient of u{t, •) at x. We refer the 
reader to [7] for a detailed treatment of the subject. 

A function u will be said to be semiconcave on an open subset U of if for 
every x G U there exists a vector px G such that 

u{y) — u{x) ^ {px,y — x) + \y — x\ Q{\y — x\) for every y & U, 

where is a modulus. The vectors px satisfying such inequality are precisely the 
elements of D~^u{x), which is thus always nonempty in U. Moreover, d'^u{x) = 
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D'^u{x) for every x (z U, yielding in particular that Du is continuous on its domain 
of definition in U, see [6]. Finally, we say that a function u is semiconvex if —u is 
semiconcave. 

Throughout the paper, (ri, J-", P) will denote a separable probability space, where P 
is the probability measure and J- the cr-algebra of P~measurable sets. Here separable 
is understood in the measure theoretic sense, meaning that the Hilbert space L'^{Q) 
is separable, cf. [26] also for other equivalent definitions. A property will be said to 
hold almost surely {a.s. for short) on Q if it holds up to a subset of probability 0. 
We will indicate by L^(J7), p > 1, the usual Lebesgue space on Q with respect to P. 
If / G L^{n), we write for the mean of / on Q, i.e. the quantity /(w) dP(a;). 

We qualify as measurable a map from il. to itself, or to a topological space A4 with 
Borel c7-algebra B{A4), if the inverse image of any set in J- or in B{M) belongs to 
J^. The latter will be also called random variable with values in A4. 

We will be interested in the case when the range of a random variable is the 
Polish space (i.e. a complete and separable metric space) C(M^) of continuous 
real functions on M^, endowed with a metric d inducing the topology of uniform 
convergence on compact subsets of M^. It can be for instance defined by 
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We will furthermore denote by Lip^(M" ) the subspace of C(M ) made up of Lipschitz- 
continuous real functions with Lipschitz constant less than or equal to ■!? > 0. We 
will briefly say Lipschitz random function to mean a ?9-Lipschitz random function 
for some i? > 0. 

Let {fn)n be a sequence of random variables taking values in C(R^). We will say 
that /„ converge to / in probability if, for every e > 0, 

¥{{u} en : d{fn{u)), f{oj)) > e}) ^ as n ^ +oo. 

The limit / is still a random variable. Since C(M^) is a separable metric space, 
almost sure convergence, i.e. d (/„(a;), /(a;)) — >■ a.s. in u), implies convergence 
in probability, while the converse is not true in general. However, the following 
characterization holds: 

Theorem 2.1. Let fn,f be random variables with values in C(M^). Then fn^f 
in probability if and only if every subsequence {fnk)k has a subsequence converging 
to f a.s.. 

We denote by L'^(i7; C(M^)) the space made up by the equivalence classes of 
random variables with values in C(M^) for the relation of almost sure equality. For 
every f,ge L°{Q; C(M^)), we set 

/i(/,g) := inf{e > : P({l^ G Q : d{f{u),g{u)) > e}) < e}. 

Theorem 2.2. fj, is a metric, named after Ky Fan, which metrizes convergence 
in probability, i.e. fJ-ifn, f) if o,nd only if fn ^ f in probability, and turns 
L0(17;C(M^)) into a Polish space. 

2.2. Stationary ergodic setting. An N -dimensional dynamical system {tx)x^rn 
is defined as a family of mappings r^^ : 17 — )• i7 which satisfy the following properties: 

(1) the group property: tq = id, T^+y = r^oTy] 
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(2) the mappings Tx '■ ^ ^ ^ are measurable and measure preserving, i.e. 
"^{t^E) = ¥{E) for every S G J"; 

(3) the map {x,uj) ^ TxUJ from x to is jointly measurable, i.e. measurable 
with respect to the product fi-algebra S(M^) (S> T . 

We will moreover assume that {tx^x&.^ ergodic, i.e. that one of the following 
equivalent conditions hold: 

(i) every measurable function / defined on such that, for every x € M^, 
/{txUj) = f{uj) a.s. in fi, is almost surely constant; 

(ii) every set T such that ¥{txAA.A) = for every x E has probability 
either or 1, where A stands for the symmetric difference. 

Given a random variable / : $7 ^ M, for any fixed w € i7 the function x ^ /(txUj) 
is said to be a realization of f . The following properties follow from Fubini's Theo- 
rem, see p] : if / € LP{n), then P-almost ah its realizations belong to Lf^^(M^); if 
fn^fin LP(il), then P-almost all realizations of fn converge to the correspond- 
ing realization of / in L]'^^(M^). The Lebesgue spaces on are understood with 
respect to the Lebesgue measure. 

A jointly measurable function v defined in x $7 is said stationary if, for every 
z € M^, there exists a set Qz with probability 1 such that for every uj £ Qz 

v{- + z,uj) = v{-,TzUj) on 

With the term (graph-measurable ) random set we indicate a set-valued function 
X -.n^ B{R'^) with 

r{X) := {{x,uj) eR^ xn : x£ X{uj) } 

jointly measurable in x 0. A random set X will be qualified as stationary if for 
every for every z € M^, there exists a set Qz of probability 1 such that 

X{tzUj) = X{uj) — z for every oj S il^. (2) 

We use a stronger notion of measurability, which is usually named in the literature 
after Effros, to define a closed random set, say X{uj). Namely we require X(uj) to 
be a closed subset of for any co and 

{uj : X{uj)nK^<l}} gJT 

with K varying among the compact (equivalently, open) subsets of M'^. If X{uj) is 
measurable in this sense then it is also graph-measurable, see [22] for more details. 

A closed random set X is called stationary if it, in addition, satisfies ([2|). Note 
that in this event the set {oj : X{uj) 7^ 0}, which is measurable by the Effros 
measurability of X, is invariant with respect to the group of translations (tx)xgrjv 
by stationarity, so it has probability either or 1 by the ergodicity assumption. 

The following holds, see |12| : 

Proposition 2.3. Let f be a continuous random function and C a closed subset of 
R. Then 

X{u) := {x : f{x,u) G C} 
is a closed random set in M^. If in addition f is stationary, then X is stationary. 

Definition 2.4. A random Lips chitz function v is said to have stationary increments 
if, for every z G M^, there exists a set il^ of probability 1 such that 

v{x + z,u!) — v{y + z,uj) = v{x, TzUj) — v{y, TzOj) for all x, y G (3) 
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for every uj & 0,^- This is equivalent to requiring that there exists a random variable 
k{u}), depending on z, for which 

v{- + z,uj) = v{-,Tzio) + k{uj) onW^ for every u G Q^- (4) 

Let v be a Lipschitz random function with stationary increments. For every fixed 
X G M.^ , the random variable Dv{x, •) is well defined on a set of probability 1, 
see [11) for the details. Accordingly, we can define the mean 'E,(Dv(x, ■)), which is 
furthermore independent of x by the stationary character of Dv. We are interested 
in the case when this mean is zero. 

Definition 2.5. A Lipschitz random function will be called admissible if it has 

stationary increments and gradient with mean 0. 

We state a characterizations of admissible random functions and a result that 
guarantees that stationary Lipschitz random functions are admissible. 

Theorem 2.6. A Lipschitz random function v with stationary increments has gra- 
dient with vanishing mean if and only if it is almost surely sublinear at infinity, 
namely 

v{x,Lv) . 
lim — i — i — = U a.s. m uj. (b) 



Theorem 2.7. Any stationary Lipschitz random function v is admissible. 

2.3. Stochastic Hamilton Jacobi equations. We consider an Hamiltonian 

H ■.R'^ xR^ xn^R 
satisfying the following conditions: 
(HI) the map oj i-^ H{-, -,0;) from Q to the Polish space C(M^ xM^) is measurable; 
(H2) H{x, -jUj) is convex on R^ for every {x,ui) € R^ x ft; 
(H3) there exist two superlinear functions a, (3 : — > R such that 

a{\p\) < H{x,p,uj) <f3{\p\) for ah {x,p,u}) eR^ xR^ xQ; 
(H4) H{- + z,-,uj) = H{-,-,T^uj) for every (z,a;) € X 

Remark 2.8. Condition (H3) is equivalent to saying that H is superlinear and 
locally bounded in p, uniformly with respect to {x,uj). We deduce from (H2) 

\H{x,p,uj) — H{x,q,uj)\ < Lr\p — q\ for all x, a;, and p, g in i?^, (6) 

where Lji = sup{ \H{x,p,uj)\ : {x,uj) € x Q, \p\ < R + 2}, which is finite thanks 
to (H3). 

For every a E M, we are interested in the stochastic Hamilton-Jacobi equation 

H{x, Dv{x, uj),uj)=a in M^. (7) 

The material we are about to expose has been already presented in [10^ \TT\ [12], to 
which we refer for the details. Here we just recall the main items. 

We say that a Lipschitz random function is a solution (resp. subsolution) of ([7]) 
if it is a viscosity solution (resp. a.e. subsolution) of d?]) for every a; in a set of 
probability 1. We recall that, due to the convexity assumption (H2), the notion of 
almost everywhere subsolution is equivalent to the one in the viscosity sense. We 
refer the reader to [21, ^3] for more details on the theory of viscosity solutions in the 
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deterministic case. Notice that any such subsolution is almost surely in Lip^^(M'^), 
where 

Ka '■= sup{ \p\ : H{x,p,uj) < a for some {x,uj) G x il}, (8) 

which is finite thanks to (H3). We are interested in the class of admissible subso- 
lutions, hereafter denoted by Sa, i.e. random functions taking values in Lip^^(M) 
with stationary increments and zero mean gradient that are subsolutions of ([7]). 
An admissible solution will be also named exact corrector, remembering its role in 
homogenization. 

We proceed by defining the free and the stationary random critical value, denoted 
by Cf{uj) and c respectively, as follows: 

Cf{uj) = inf {a G M : dl]) has a subsolution v G Lip(R^)} , (9) 
c = inf{a G M : 5^ 7^ 0}. (10) 

We emphasize that in definition ([9]) we are considering deterministic a.e. subsolu- 
tions V of the equation ([7|), where cj is treated as a fixed parameter. Furthermore, 
we note that Cf{TzOj) = Cf{uj) for every {z,u) G x 0, so that, by ergodicity, 
the random variable Cf{uj) is almost surely equal to a constant, still denoted by c/. 
Hereafter we will write fij for the set of probability 1 where Cf{u) equals Cf. 

It is apparent by the definitions that c > Cf. The relation of these two values 
with the effective Hamiltonian obtained via the homogenization |231 [25] is discussed 
in [211 HI]. 

In the sequel, we will focus our attention on the critical equation 

H{x,Dv{x,u}),uj) = c inM^. (11) 
The following result holds, see [2T| [TT]: 

Theorem 2.9. There exist admissible critical subsolutions, i.e. Sc 7^ 0. 

Moreover, the critical equation is the only equation of the kind ([7]) for which exact 
correctors may exist, see |12| . 

We recall the main items of the so called metric method for Hamilton-Jacobi 
equations, as adapted in |11] to the case at issue. In next formulae we assume that 
a > Cf and uj G ^Ij. Let 

Za{x,uj) := {p : H{x,p,uj) <a}, 

be the a-sublevels of the Hamiltonian and 

aa{x,q,uj) ■.= sup{{q,p) : p £ Za{x,uj)} 

the related support functions. It comes from ([6]) (cf. Lemma 4.6 in p2]) that, given 
b > a, we can find p = p{b, a) > with 

Zaix,uj) + BpC Zh{x,uj) for every {x,uj) G x 0/. (12) 

It is straightforward to check that aa is convex in q, upper semicontinuous in x and, 
in addition, continuous whenever Za{x,u;) has nonempty interior or reduces to a 
point. We extend the definition of aa to x x $7 by setting aa{-,-,uj) = 
for every uj G \ il/. With this choice, the function aa is jointly measurable in 
X X ft and enjoys the stationarity property 

aa{- + z, ■,uj) = aa{-, ■,TzUj) for every z G and uj ^Vt. 
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We define the semidistance Sa as 



Saix,y,u;)=M{ I ^,(7(5), 7(5), a;) ds : 7 G Lip,,j,([0, 1]; ) [> . (13) 







The following holds, cf. \17]: 

Proposition 2.10. Let a > Cf and uj £ Qf. We have: 

(i) For any y G M^, the function Sa{y, -jw) is a subsolution of ^ in M^, and 
also a solution in M.^ \ {y}. 

(ii) A continuous function (j) is a subsolution of ^ if and only if 

(p{x) - (p{y) < Sa{y,x,uj) for all x,y £R^. 

2.4. Positive and negative Lax Oleinik semigroups. The Lagrangian associ- 
ated with H by duality is the function defined as 

L{x,q,uj) := max {{p,q) — H{x,p,u>)} for all {x,q,uj) € x x Q. 



As well known, the Lagrangian satisfies properties analogous to (H1)-(H4). 
For every t > and G 0, we define a function ht on x as 

ht{x, y, uj) := inf <^ / L(7, 7, w) ds : 7(0) = x, -f{t) = y 







Curves that realize the above infimum are called Lagrangian minimizers. It is well 
known that such minimizers always exist and they are Lipschitz continuous, see [5]. 
It is known, see for instance |15j, that 

Sa{y,x,u) = inf (^ht{y,x,Lj) + at^ (14) 

for every a E M and oj (z flf. In particular, when uj G Qf and a > c/, we derive, in 
view of Proposition 12.101 that a function v is a subsolution of ([7| if and only if 



v{x) — v{y) < ht{x, y) + at for every x, 1/ € M and t > 0. 

For every t > and every K-Lipschitz random function u, we next define the 
negative and positive Lax-Oleinik semigroups Tfu, T^u as follows: 

{T^u){x,uj) := inf {u{y,uj) + ht{y,x,uj) : y eR^} 

{Tf^u){x,uj) := sup {u{y,uj) - ht{x,y,uj) : y eR^ } 

for every {x,uj) G x Q. 

Remark 2.11. It is worth noticing that T^u = —Tf{—u), where we have denoted 
by T[~ the negative Lax-Oleinik semigroup associated with the Hamiltonian H de- 
fined by 

H{x,p,Ll)) := H{x, —p,u!) for every {x,p,uj) € x R^ x ft. 

We list a series of properties enjoyed by such semigroups. 

Proposition 2.12. Let > 0. Then there exists i?(i?) > such that for every 
"d-Lipschitz random function u and every uj € ft the following properties hold: 

(i) {Tfu){x,uj)<mi{u{y,uj) + ht{y,x,uj) : \x - y\ > t R{-d)} , 

{T^u){x,uj) > sup {u{y,uj) - ht{y,x,uj) : \x - y\ > t R{i!}) } ; 



(ii) the maps {t,x) i— )• T^u{x) are R{'d)-Lipschitz continuous on [0, +00) x M^. 
In particular 

\\T^u{-,uj) — u{-,uj)\\oo < t R{'d) for every t > 0; 

(Hi) if u has stationary increments (resp. is stationary) , then T^u have station- 
ary increments (resp. are stationary) for any t > 0. 

Items (i), (ii) are the ergodic stationary version of well known estimates holding in 
deterministic case. Bounding function R{-) solely depends on the a(-), /3(-) appearing 
in (H3), which are invariant with respect to u. Item (Hi) is straightforward. 

Proposition 2.13. Let uq be a Lipschitz random function. Then, for every fixed oj G 
f], the function u{t,x) = {Tfuo){x,Lo) is the unique Lipschitz continuous viscosity 
solution of the time-dependent equation 

dtu + H{x,Du,oj) =0 m(0,+cx))xR^ (15) 

satisfying u{0,x) = uo{x,lo) on M^. 

Proposition 2.14. Let u be a continuous function on and let uj be fixed. The 
following facts hold: 

(i) u is a subsolution of ([7]) if and only ift 1— t- T^u{-,uj)+at is non-decreasing; 
(ii) u is a solution of ^ if and only if u = Tfu{-,uj) + at for every t > 0. 

As a consequence of the previous results, we deduce the following fact: 

Proposition 2.15. Let u £ Sa. Then both T^u and Tfu belong to Sa, for every 
t > 0. 

3. Continuous Hamiltonians 

In this section we assume H to satisfy assumptions (H1)-(H4). In the first sub- 
section we give the definition of random Aubry set and we prove the existence of a 
critical admissible subsolution that is weakly strict, in a sense that will be clarified, 
outside it. This can be regarded as a completion of [10], where analogous results 
were obtained under an additional assumption, see (jA]) below. In the second subsec- 
tion we show how a strict admissible critical subsolution can be produced starting 
from a weakly strict one. For the outcomes of both subsections, we essentially use 
the (negative) Lax-Oleinik semigroup and its properties. 

From now on we will assume the stationary critical value c = 0, which is not 
restrictive up to replacing H with H — c, and focus our analysis on such critical 
level. To ease notation, we will omit the subscript c when no ambiguity is possible. 
In particular, we will simply write S, S, k. and a in place of Sc, Sc, Kc and ac- 

3.1. Aubry set and weakly strict subsolutions. We start by recalling the def- 
inition of the classical Aubry set. 

Definition 3.1. The classical Aubry set Af{uj) is the closed stationary random set 
defined as follows: 

^/(w) = {y€M^ : liminf /it (y,y,a;) = 0} foranyui^Q. 
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The random set Af{u}) is always almost surely empty when the random critical 
value is strictly greater than cj, i.e. when cj < 0. When cj = 0, Af{uj) may be 
either almost surely nonempty or almost surely empty. This latter instance is not 
specific of the stationary ergodic setting: it can occur even in the periodic case. 

We proceed by presenting the notion of random Aubry set as introduced in [10] . 
For this, we need to recall some facts about Lax formulae in the stationary ergodic 
setting, see |1H [T2] for more details. For any given almost surely nonempty sta- 
tionary closed random set C{uj) in and any critical subsolution g ^ S, the Lax 
formula is given by 

u{x,uj) ■.= mi{g{y,u}) + S{y,x,u}) : y eC{u})} xeR^, (16) 

and provides another admissible critical subsolution enjoying some additional prop- 
erties, see Proposition 4.1 in [10]. More precisely, u{-,uj) is the maximal critical 
subsolution agreeing with g{-,uj) on C{uj) a.s. in w, and, as a consequence 

u(-,uj) is a critical solution in \ C{uj) a.s. in uj . (17) 

In the above formula we agree that u{-,uj) = when either C{u;) = or the infimum 
is equal to — oo. 

Inspired by the periodic model case, we define the stationary random Aubry set 
as follows: 

Definition 3.2. A stationary and almost surely nonempty closed random set C{uj) 
will be called random Aubry set and will be denoted by A{uj) if 

(i) the extension of any admissible critical subsolution from C{ijj) via the Lax 

formula (I16p yields an admissible critical solution; 
(ii) any stationary and almost surely nonempty closed random set that satisfies 

the previous property is almost surely contained in C{uj). 

If there are no stationary and almost surely nonempty closed random sets satisfying 
(i), we agree that the Aubry set is almost surely empty. 

We now proceed to show that the above definition is well posed. For this, we will 
take on the burden of checking that, if there is some nonempty stationary closed 
random set satisfying item (i) above, then there is also a maximal one. This task is 
by no means trivial, the main difficulty being the following: the random sets needed 
for the construction cannot be defined by treating cj as a fixed parameter because 
this procedure would lead to objects that do not satisfy the proper measurability 
hypotheses. 

We also underline that the case of an almost surely empty random Aubry set (i.e. 
the case of nonexistence of nonempty stationary closed random set satisfying item 
(i) above) can actually occur, see for instance Example 4.10 in [llj . 

The fact that Definition 13.21 is well-posed has been already shown in [WJ under 
the following additional assumption: 

either c/ < or c/ = and Af{uj) = a.s. in uj. (A) 

As already announced, the novelty here is that we get rid of by using the negative 
Lax-Oleinik semigroup. 

In order to state the result we aim at, we need the following 
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Definition 3.3. Let C{uj) a stationary closed random set. A critical subsolution 
V ^ S is said to be weakly strict in \ C{uj) if the following property holds a.s. in 
to: 

v{x,U!) — v{y,uj) < S{y,x,uj) for every x,y £ \ C{ui) with x y. (18) 

Notice that the inequality (fTSj) keeps holding even if one (but only one) between 
the points x,y belongs to C{uj). This can be deduced from the fact that S{-, -,0;) is 
a geodesic-type semidistance. 

Theorem 3.4. The definition of random Aubry set A{uj) is well posed. Moreover, 
there is a critical subsolution which is weakly strict in \ A{uj) . 

Under assumption ([X]), it has been provided in [TO] a sort of dual characterization 
of Aubry set as the minimal stationary closed random set for which there exists a 
critical admissible subsolution weakly strict in its complement. To prove the above 
theorem, we try to generalize this approach. We thus define, for each v € 5, 

X^{uj) = {x G : {T-v){x,u}) = v{x,uj) for some t > 0}. (19) 

At first sight these objects are not so appealing, from a mathematical point of 
view, since it does not seem possible to determine their randomness properties or 
even the topological features of their images, as uj varies in 0. Nevertheless, we 
keep under control our uneasiness and go on constructing, through suitable infinite 
convex combinations, a distinguished critical subsolution, denoted by for which 
it is possible to define a stationary closed random set almost surely agreeing with 

Xyj{uj). 

We proceed by showing a property enjoyed by such sets Xy that will be relevant 
for our analysis. The following fact will be exploited in the proof and later on in the 
paper: when v{-,uj) is a critical subsolution, the equality {Tfv){x,uj) = v{x,uj) for 
some t > implies the existence of a point y G satisfying 

ht{y,x,uj) = v{x,uj) - v{y,uj) = S{y,x,uj). 

The last equality follows from Proposition 12.101 and (jl4p with a = 0. 

Proposition 3.5. Let v G S. Then there exists a set il^ of probability 1 such that, 
for every uj £ and xq G Xy{uj), any subtangent ip to v{-,uj) at xq satisfies 
H{xo,DiP{xo),u)>0. 

Proof. Let us fix oj in a set Q of probability 1 such that v{-,uj) is a critical sub- 
solution and pick xq G X^^oj). By definition of Xy{uj), we find t > and y G 
with 

v{xo,uj) = v{y,uj) + ht{y,xo,uj) = v{y,uj) + S{y,xo,uj). (20) 

This implies that the function U(-) := S{y, -,0;) + v{y,uj) touches v{-,uj) from above 
at Xq, so any subtangent to v{-,uj) at xq is also a subtangent to v at that point. 

If y Xq, the assertion follows since I; is a critical solution in \ {y}. If instead 
y = Xq, then the we deduce from ([20]) the equality ht{xo, xo,u}) = S{xo, xo,io) = 0. 
This means that there exists a closed curve 7 parameterized in the interval [0, t] and 
with base point at xq along which the action of L(-, -,0;) is zero. By moving along 7 
fe-times we infer that hktixo, xo,uj) = for any G N. This, in turn, implies 

liminf /is(xo,xo,w) = 0, 

s— >+oo 

12 



and this relation is possible only when c/ = and xq € Af{u}). In this instance v 
is a critical solution on the whole M'^, see [15] (or [I^ for a proof in the case of a 
convex Hamiltonian just continuous). This concludes the proof. □ 

Given v G 5, we set 

v{x,uj) := v{x,uj) — v(0,uj) for every {x,uj) S x 17. (21) 

The set made up by critical subsolutions obtained in this way, namely 

S := {v €^ S : ^(O, oo) = for every cj} 

is a subspace of L^{Q, C(M^)), in particular it is separable with respect to the Ky Fan 
metric by Theorem 12.21 There thus exists a sequence of Lipschitz random functions 
{vn)n dense in S with respect to convergence in probability, which implies, in view 
of Theorem 12. 11 that it is also dense for the almost sure convergence in C(R^). We 
set 

+ 00 ^ 

w{x,u!) = > —Vn{x,u!) for evcry {x,u!) G x il. (22) 
2" 

n=l 

The next result illustrates the first crucial property enjoyed by w. 

Proposition 3.6. For every v £ S there exists a set of probability 1 such that 

Xwi'^) ^ X.u{uj) for every uj ^Q.^. 

Proof. The proof is divided in two parts. First we prove the assertion for any 
element of the sequence {vn)n-, then, in the second step, we extend it, by density, to 
all random functions in S. This is actually enough, for Xy{oj) = Xy{uj), for any w, 
whenever v and v are in the relation given by (I2ip . We set 

:= {a; € $1 : v„(-,a;) is a critical subsolution for every n G N} 

and pick a; G il, x G X^(ljj). Then there exists t > such that {T^ w){x,Ljj) = 
w{x,uj). By the very definition of Tf 

iTfw){x,uj) > ^ — iTfVn)ix,U}), 
n=l 

and, combining this information with the monotonic character of the action of the 
negative Lax-Oleinik semigroup on critical subsolutions pointed out in Proposition 
[2T51 we get 

+ 00 ^ +00 ^ 

{Tfw){x,Uj) > ^ — {TfVn)ix,Uj) > ^—Vn{x,U}) =w{x,Uj), 
n=l n=l 

discovering in the end that all the inequalities in the above formula have actually to 
be equalities. In particular we infer 

{TfVn){x,uj) = Vnix,u)) for every n G N, (23) 

which proves that Xuj{uj) C Xt,,^(a;) for every a; G 17 and n G N. Now let v G 5. 
Then there exist a subsequence {vnf,)k such that 

Vn^{-,UJ)^V{-,^) (24) 

for every w in a set 17^, C $7 of probability 1. Given a; G 17,^ and a point x G Xyj{ijj), 
we have, in force of the first part of the proof, that (|23p holds for some t > 0, from 
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which we derive v{x,uj) = v{x,uj) in view of (p^ . This shows that x S Xy{uj), 
as desired. □ 



Remark 3.7. The argument in the previous proof actually allows to establish the 
following more general result: for any given v & S and t > 

Xl{u>) C Xl^{uj) for a.s. u>, 

where 

= {x G : iTfv){x,uj) = v{x,uj)} (25) 
and X^(w) is defined similarly. 

In the next proposition we show that the action of the negative Lax-Oleinik 
semigroup does not affect the values of w on Xw{uj) not only for some positive t, as 
required in the original definition of such a set, see (I19p . but actually for all t > 0, 
at least a.s. in u. 

Proposition 3.8. 

Xy,{uj) = {x S : {Tfw){x,u>) = w{x,u>) for every t > 0} a.s. in uj. 

Proof. Let be a set of probability 1 such that w{-,ljj) is a critical subsolution. 
According to the monotonicity property stated in Proposition 12. 14^ the following 
implication holds for every w E il: 

{T^^w){x,uJ) = w{x,uj) T^w{x,uj) = w{x,uj) for s G [0,t]. (26) 

To prove the assertion, it will be enough to show that, for every a; in a set of 
probability 1, 

sup{t > : Tfw{x,uj) = w{x,uj)} = +oo for every x € Xw{uj). 

To this aim, we consider a sequence (tn)n dense in [0,+oo), and set Vn = T^w. 
According to Remark 13. 7|, there is a set il' C 17 of probability 1 with 

(w) C Xll (w) for any n e N and u € n' , (27) 

see for the notation. Fix a; € 0, x € X^{u!), and assume for purposes of 
contradiction 

max{i > : Tfw{x,uj) = w{x,uj)} =: s < oo, 

then select tk with 

tk<s<2tk. (28) 

By m 

(Tf~w){x,uj) = w{x,uj), (29) 
or, in other terms, x G X^{uj). In view of (f27|) we get x G X**(c<j), i.e. 

iTt-+t^w){x,uj) = {Tt-w){x,uj). 
Combining it with ()29p . we get 

iT2t,,'w){x,Uj) = W{X,LV), 

which is in contrast with (j28p and the maximality property of s. □ 
We go on gathering some more information on X^. 
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Proposition 3.9. Let cj = 0. There exists a set 0, of probability 1 such that 

C Xw{uj) for every oj & Q. 

Proof. Let O be a set of probability 1 such that w{-,(jj) is a critical subsolution. 
Then, exploiting Proposition 12.141 and the very definition of T^w , we have, for 
every t > and x € M^, 

w{x,u)) < {Tfw){x,uj) < liminf w{x,uj) + ht{x, x,uj). (30) 

i— >-+oo 

When Cf = and x € Af{uj) 

liminf /it(x,x,a;) = 0, (31) 

t— i>+oo 

so that, combining (pO|) and ([3T]) . we get in the end 'w{x,uj) = {Tf'w){x,uj). □ 

We pause our analysis on w to derive a general characterization of weakly strict 
subsolutions in terms of strict monotonicity of the action of the negative Lax-Oleinik 
semigroup. 

Lemma 3.10. Let v (z S and C{u;) be a stationary closed random set. If Cf = 0, 
we additionally assume that Af{uj) Q C{oj) a.s. in lo. Then v is weakly strict in 
\ C{uj) if and only if there exists a set ft of probability 1 such that 

{Tfw){y,uj)>w{y,uj) for any y eR^ \C{uj), co eh and t > 0. (32) 

Proof. Let be a set of probability 1 made up of elements uj e fl for which w{-,u}) 
is a critical subsolution and enjoys (fTSl) . Throughout the proof, oj will denote a fixed 
element of Q. Were (I32p not true, we should have by Proposition 12.141 

{Tfw){y,uj) = w{y,uj), 

for some t > and y C{u}), and by the principle we have written down before the 
statement of Proposition 13. 5| this should in turn imply 

w{y,uj) — w{z,uj) = S{z,y,uj) for some z G M^, (33) 

in contrast with the fact that w{-,uj) is weakly strict and y ^ C{uj). 

The converse implication will be also proved by contradiction. Assume that (I33p 
holds for some y, z not belonging to C{lj). Exploiting that 5(-, -jUj) is a geodesic 
semidistance, we can assume, up to moving y, that there is a curve 7 : [0, 1] 
joining z to y and with support disjoint from C{uj) such that 

w{y,uj) - w{z,uj) = cr(7,7,a;)ds. 
Jo 

Since the support of 7 is also by assumption disjoint from Af{uj) in the case that 
Of = 0, we can provide such curve a 0-Lagrangian change of parameter in a bounded 
interval [0, t], for some t > 0, see [9], [13]. Namely, we can determine a reparametriza- 
tion ^ with 

aias),i{s),u;) = L(e(s),^(s),w) for a.e. s G [0,t]. 

We deduce ^ 

w{y,u}) = w{z,u}) + / L{-f,^,uj)ds > {Tfw){y,u}), 
Jo 
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but since the opposite inequahty comes from Proposition 12.14^ the above formula 
must actually hold with equality, yielding a contradiction. 

□ 

We are now in position to give the 

Proof of Theorem 13. 4L Let w be defined via ([22]) and set 

C{uj) = {re G : {T^^^w){x,uj) = w{x,u}) } for every w, 

where (s„)„ is any dense sequence in M+. It is easily seen that C{ijj) is stationary 
closed random set. Moreover, by the monotonicity property stated in Proposition 
[lHand by Proposition ESI 

C{(jj) = Xw{ijj) a.s. in uj. (34) 

We claim that w is weakly strict in \ C{u)) and that C{(jj) is the Aubry set. 

Let us start with the weakly strict character of w in MJ^ \ C{oj). In view of (I34p 
and of Propositions 13.91 foi' every a; in a set of probability 1 we have 

{Tfw){y,Lo) > w{y,uj) for every y G \ C{uj) and t > (35) 

and Af{uj) C C{uj) if c/ = 0. By Lemma [3. 10^ we conclude that w is weakly strict 
in R^\C(w). 

Let us now show that C{uj) is the Aubry set, i.e. it is the maximal stationary closed 
random set satisfying item (i) in Definition 13.21 We start by proving the maximality 
property. Let C{lj) be a nonempty stationary closed random set satisfying item (i) 
in Definition 13.21 and set 

u{x,uj) := mi{w{y,uj) + S{y,x,uj) :y£C{uj)}, x € M^. 

Since u is an admissible critical solution, we infer from Proposition 12.141 that the 
following equality holds for every a; in a set of probability 1: 

Tf u{- , uj) = u{- , uj) on for every t > 0. (36) 

Take w G 17 such that w{-,uj) is a critical subsolution, C{uj) ^ and ()36p holds. We 
know that w{-,uj) < u(-,uj) in and w{-,uj) = u{-,uj) in C{uj). By the monotone 
character of the operator Tf we deduce 

w{x,uj) < {Tf'w){x,uj) < (Tfu){x,uj) = w{x,uj) for every t > 0. 

Hence all the inequalities in the above formula are indeed equalities, yielding C{oj) C 
C{uj) a.s. in uj. 

In particular, we derive that A{u)) = C{uj) when C{uj) is almost surely empty, 
since the above argument implies, in this instance, that stationary and nonempty 
closed random sets satisfying (i) \n Definition 13.21 do not exist. 

Let us then assume that C{uj) ^ a.s. in a; and let us check that it satisfies (i) 
Definition 13.21 Pick a critical subsolution g & S and let u be the admissible critical 
subsolution defined through (fT6|) . To prove that u{-,uj) is an almost sure critical 
solution on M^, we only have to check, in view of ()17p . that the supersolution test 
is satisfied on C{uj) a.s. in oj. But this follows in view of ()34p and of Propositions 
13.61 and 1 3.51 with v := u. □ 
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Remark 3.11. Since u is a subsolution of = a if and only if —v is a subsolution 
of H = a, then H and H have the same critical value. Moreover, if f is a critical 
subsolution for H which is weakly strict outside some stationary closed random set 
C{uj), then —v is critical for H and weakly strict outside C{uj), see Proposition 5.10 
in |10] for more detail. In view of Theorem 13.41 and Remark I3.13| this implies that 
H and H have the same Aubry set. 



We finally record for later use that, as a consequence of Theorem 13.41 we are able 
to extend Theorem 5.9 in |10] . employing the same argument used there, as follows: 

Theorem 3.12. Assume that A{uj) ^ a.s. in uj. Then there exists a set Q, 
of probability 1 such that for any oj ^ and any x G A{u]) we can find a curve 
7?2^ : M — )• A{oj) (depending on u) with r]x{0) = x satisfying the following properties: 
(i) for every a < b inR 

S{r]x{a),r]x{b),uj) = L(r/a;, r)^, cj) ds; 

J a 

(a) for every v € S there exists a set of probability 1 such that for every 




L{r]a:,r]x,(^) ds = v{r]x{b),uj) - v{r]x{a),uj) for every a <b inR. 



If condition (jAj holds, we furthermore have lim = +oo. 



Remark 3.13. From Theorems 13.41 and 13.121 we deduce that A{uj) is the minimal 
stationary closed random set for which there exists a critical admissible subsolution 
which is weakly strict in its complement. 



3.2. Strict critical subsolutions. The purpose of this section is to reinforce The- 
orem 13.41 showing the existence of a critical subsolution enjoying the property of 
being strict outside the Aubry set in a stronger and more classical sense. 

Definition 3.14. Let C{uj) a stationary closed random set. A critical subsolution 
V £ S is said to be strict in \ C{uj) if the following property holds a.s. in uj: 

for every open set U compactly contained in R^ \ C{uj) there exists 5 > such 
that 

H{x, Dv{x,uj),uj) < —5 for a.e. x £U. (37) 

We will say that v is (weakly) strict, with no further specification, to mean that 
it is (weakly) strict in \ A{uj). 

Next lemma makes precise that the previous notion is actually a strengthening of 
that of weakly strict subsolution. It is a purely deterministic result, where uj plays 
just the role of a parameter, and so is omitted for notational simplicity. 

Lemma 3.15. Let v be a critical subsolution satisfying (j37p in some open subset U 
ofR^ and for some 6 > 0. Then 

v{x) — v{y) < S{y, x) for every x G U and y ^ x. (38) 
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a(7,7)ds. (39) 



Proof. Let x £ U and Br{x) be any closed ball contained in U. Since S" is a 
geodesic-type semidistance, it will be enough to check ([38|) for every y G dBr{x). 

Let p = p{0, —6) > be chosen according to (fT2]) and choose a curve 7 joining y 
to X such that 

pr 
T 

Let us set r := sup{t € [0, 1] : 7(t) G \ Bj.{x) } and z = 7(r). By taking into 
account (fT2]) and the fact that the critical subsolution v satisfies (i37|l in Br{x), we 
get: 

(T(7,7)ds = y (T(7,7)ds + y (7(7, 7) ds 



+ 5(y,x) > / 

JO 



hence by ([39 



-1 

> v{z) — v{y) + v{x) — v{z) + p I |7(s)|ds. 



p r 

S{y, x) > v{x) - v{y) + ^ > v{x) - v{y). 



□ 



The converse implication does not hold. More generally, the inequality 

v{x) — v{y) < Sa{y,x) for every x, y in an open set U C 

does not imply esssup^^u H{x, Dv{x)) < a. For instance, the antiderivative of a 
function vanishing on an open and dense subset of M of small measure and equal 
to 1 in the complement is a weakly strict subsolution of the 1-dimensional Eikonal 
equation \u'\ = 1 in M, but it is not strict in M. 



The statement of the main theorem reads as follows: 

Theorem 3.16. Let H satisfy (Hl)-(H^). Then there exists a strict critical subso- 
lution in S. 

More precisely, for every weakly strict critical subsolution w G S and every e > 0, 
there exists a strict critical subsolution G 5 such that 

(i) \\w£{-,uj) — w{-^uj)\\oo < s for every bj G Q.; 

(a) Ws{-,uj) = ui{-,uj) on A{uj) a.s. inoj. 

It, in particular, implies the existence of a critical admissible subsolution, strict 
on the whole M^, when the random Aubry set is almost surely empty. 

As a consequence, we also get: 

Corollary 3.17. Let H satisfy (H1)-(H4). The set of admissible, strict critical 
subsolutions is dense in S with respect to the Ky Fan metric on L^{Q; C(]R^)). 

Proof. According to Theorems 13. 41 and 13. 161 there exists a strict critical subsolution 
in S, say it v. Now pick n G 5 and set 

Vn(x,u>) = —v{x,u}) + (1 )u(x,u}) (x,uj) G X Cl 

n n 

for every n G N. By convexity of the Hamiltonian, Vn are strict critical subsolutions 
belonging to S. Moreover 

?;„(•, w) ^ u{-,uj) for every uj € Q, 
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meaning that a;), n(-, w)) for every u & Q. Since almost sure convergence 

implies convergence in probability, we get that converge to u with respect to the 
Ky Fan metric in L^{n; C(R^)) in view of Theorem 12.21 □ 

To pass from the existence of a weakly strict admissible subsolution to that of a 
strict one, we make use of two, in a sense complementary, crucial properties of the 
Lax-Oleinik semigroups that will be proved below. The first is the invariance of the 
values of any critical subsolution on the random Aubry set under the action of Tf 
and , the second instead the strict monotonicity of Tf , when applied to a weakly 
strict critical subsolution, outside such set, at least for small times. 

Proposition 3.18. Let w (z S. Then the following property holds a.s. in u: 

Tfw{x,uj) = T^w{x,ui) = w{x,uj) for any x G A{uj) and t > 0. 

Proof. We assume that Aubry set is a.s. nonempty otherwise the statement is void. 
We take uj such that A{uj) / 0, w{-,uj) is a subsolution of the corresponding critical 
Hamilton- J acobi equation and assertion (ii) of Theorem 13.121 holds for v := w. Pick 
a point X E A{uj) and a time t > 0. According to Proposition 12.141 

Tfw{x,uj) > 'w{x,uj). 

Now, let : M ^ be the curve chosen according to Theorem 13. 121 Then 

w{x,uj) = w{r]x{-t),uj) + j L{rir,,r]^,uj)ds > {Tfw){x,u;), 

yielding equality. The assertion for T^w can be proved analogously in view of 
Remarks [2III] and EH □ 



Proposition 3.19. Let w S be weakly strict. Then we can determine a set 
of probability 1 such that for every uj E 0,^ and x E \ A{uj) there exists 
tx = tx{^) G (0, +oo] such that the function 

t ^ v{t, X, uj) := (Tfw) {x, uj) 

is strictly increasing in [0,tx) and constant for t > tx- 

Proof. Let Vt^j be a set of probability 1 made up by elements uj for which uj{-,uj) is 
a weakly strict critical subsolution. Fix uj E Q.w and x E \ A{uj). Let us define 
J as the set of times t > satisfying the following property: 

{Tfw){x,uj)=w{y,uj) + ht{y,x,uj) for some y E ^(w). (40) 

Let us set tx ■= inf J, where we agree that tx = +oo if J is empty. From Proposition 
I2.12t which bounds the distance of the point y in (|40p from x, and the fact that A{uj) 
is closed we infer that J is closed and that tx > 0. 

Let us prove that t i— ?> (T^w) {x,uj) is strictly increasing in [^,tx). Take s > t in 
[Q,tx), then 

{Tg' w){x,uj) = {T^_^w){y,uj) + ht{y,x,uj) for some y E M^. (41) 
If y E A{uj), from Proposition 13. 181 we deduce 

{T^ w){x,uj) = w{y,uj) + ht{y,x,uj) > {Tfw){x,uj), 
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were the strict inequality comes from the fact that t ^ J. If instead y ^ ^(i^), we 
invoke Lemma 13.101 which holds true for the w we are working with, to get from 

m _ 

{Ts w){x,uj) > w{y,uj) + ht{y,x,uj) > {T^ w){x,uj). 

Let us now prove that t i— )• {T^'w){x,uj) is constant in [tx,+oo) when tx < +00. 
Let y € A{uj) be a point satisfying MOD with tx in place of t. We invoke Proposition 
[XTHl to get for t > tx 

{Tfw){x,uj) < {Tf~L^^w){y,uj) + ht^{y,x,uj) = w{y,uj) + ht^{y,x,uj) = {T^^w){x,uj). 

By monotonicity properties of Lax-Oleinik semigroup pointed out in Proposition 
I2.14|, we get the assertion. □ 

To proceed in our analysis, we need two technical lemmata about locally Lipschitz 
functions and related Clarke's generalized gradients. In what follows, we denote by 
TTi, 1^2 the maps defined as T^iipt^Px) = Pt, T^2{jPt,Px) = Px for every {pt,Px) e MxM^. 

Lemma 3.20. Let v{t, x) be a locally Lipschitz function in (0, +00) x such that, 
for every bounded open subset U ofR^, the functions 

{v{-,x) : X E [/ } are locally equi-semiconcave (resp. equi-semiconvex) in (0, +00). 
Then, for every (to,a^o) £ (0,+oo) x M^, 

TTi (9'^f(to,xo)) = 5fu(to,xo), 7r2 ((9S(to,a:o)) 2 9X^0, 2;o)- 
In particular, the map {t,x) 1-^ d1v{t,x) is upper semicontinuous in (0, +cx)) x M^. 
Proof. The fact that 

TTi {d%{to,xo)) 5 dtv{to, xo), 712 {d^vito, xo)) 5 dxv{to,xo) 

for every {tQ,XQ) € (0, +00) x follows from Proposition 2.3.16 of [7J. To prove 
that TTi {d^v{to,xo)) = dfv{to, xq), it will be enough to show that 

TTi {d*v{to,Xo)) C diV{tQ,Xo). 

Let pto € vTi {d*v{tQ, xq)) and let (tn,Xn) be a sequence of differentiability points 
for V converging to {tQ,xo) such that dtv{tn,Xn) ='■ Pt„ — > Pto as n — )• +cx3. The 
functions 

<t)n{t) := W{t - to + tn,Xn) 

are locally equi-semiconcave (resp. equi-semiconvex) in (0, +00) and 

0n ^ v{-,xq) in (0, +00). 

Moreover are differentiable at to and 4>'n{io) = Pt^-, in particular pt„ belongs 
to the superdifferential (resp. subdifferential) of at to by semiconcavity (resp. 
semiconvexity) . This property passes to the limit since the functions are locally 
equi-semiconcave (resp. equi-semiconvex), hence pt^ belongs to the superdifferential 
(resp. subdifferential) of the function v{-,xq) at to, that is to 9ft'(to,xo). 

Since the map (t, x) 1-^ d'^v{t,x) is upper semicontinuous in (0,+cx3) x M^, so is 
the map (t,x) 1-^ ■7ri{d'^v{t,x)), from which we get the last assertion in view of the 
identity just established. □ 

Lemma 3.21. Let v{t, x) be a locally Lipschitz function in (0, +0x0) xM^ and assume 
there is a bounded open subset U ofM.^ such that 

20 



(i) the functions {v{-,x) : x S C/ } are locally equi-semiconcave (resp. equi- 
semiconvex) in (0, +00); 

(ii) for every x the map 

t ^ v{t,x) is strictly increasing in [0,tx) 

for some t^ G (0, +00]. 
Then, for every x (z U, the set 

lx:={t>0 : mm{pt : pt G d^v{t,x)} > 0} 

is open and dense in (0,^^;). 

Proof. Let us fix x E f/ and set 

f{t) = mm{r : pt € dtv{t,x)} for every t > 0. 

Thanks to Lemma [3.201 tlie set-valued map t 1— )• dtv(t,x) is upper semicontinuous. 
Consequently, the function / is lower semicontinuous, so that 

l, = {t>0 : fit) > 0} 

is open. Let us prove that it is dense in {0,tx)- This is indeed a consequence of the 
strict monotonicity of t v{t,x) in [0,tx)- Because of it, in fact, in any subinterval 
of {0,tx) we find differentiability points of v{-,x) with positive derivative. Since 
any such point, say to, is of strict differentiability due to the semiconcavity (resp. 
semiconvexity) of v{-,x), the corresponding derivative is also the unique generalized 
gradient, which shows that to G Ix and proves the statement. □ 

Our strategy for proving Theorem 13.161 is structured in two parts: we first show 
the result under the additional assumption that the H is strictly convex and then 
generalize it to Hamiltonians solely convex by means of a regularization in time of 
the action of the negative Lax-Oleinik semigroup via t-partial sup convolutions. 

Proof of Theorem 13.161 for H strictly convex. The precise statement of our 
extra assumption is: 

(H2') H{x, -,0;) is strictly convex on for every {x,io) G x 0. 

Let w S he a weakly strict subsolution and let e > be fixed. The main effect of 
(H2') is that the function 

v{t,x,oj) := {Tfw){x,oj), (t, X, w) G (0, +00) X X 1^, (42) 

is locally semiconcave in (0, +00) with respect to t, see Lemma 2.11 in [H]. More 
precisely, for every open and bounded set U C and every fixed lo ^ Q the 
functions 

{v{-,x,u}) : X £ U} are locally equi-semiconcave in (0, +00). 

Let K be the constant given by dH) with a = and let R{k) be chosen according 
to Proposition 12.12"! Choose r > such that t R{k) < e and let (i„)n be a dense 
sequence in (0,r). We define 

+00 ^ 

Weix,Lj) = ^ — v{tn,X,Uj), (x, w) G X f]. (43) 

n=l 
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By Proposition 12.151 we get 

+00 ^ 

\\We{-,Uj) - w{-,Uj)\\oo < X] ll^^*'^' ■'^) ~ w{-,Uj)\\oc < tR{k) < £ 

n=l ^ 

for every a; € il, showing in particular that a; ) is finite- valued. As a convex 
combination of admissible critical subsolutions, see Proposition 12. 15^ a standard 
argument shows that is an admissible subsolution as well. From Proposition 13.18] 
we also infer 

Ws{: lOS) = w{; ^Ijj) OYi A(lS) (44) 

a.s. in uj. It is left to show that is strict. To this purpose, let us fix uj in 
a set of probability 1 made up of elements for which the assertion of Proposition 
13.191 holds true and the functions t)(t„,-,u;) are critical subsolutions. Pick a point 
2/ e \ A{uS). According to Lemma [321] and by density of the sequence (in)n 
(0, r), there exist i S N and a > such that 

min{pt : pt G dtv{ti,y,uj)} > a. (45) 

By upper semicontinuity of the set-valued map x i-)- dfv{ti, x, oj), we infer that (H5]l 
keep holding in a ball Br{y). Now we exploit the fact that u(-, -,0;) is a (sub)solution 
of the time-dependent equation (fT5]l . in view of Proposition 12.131 so 

pt + H{x,px,uj) < for every ipt,Px) G d^'viU, x,uj) and x G Briy). 

In view of Lemma 13.201 and of what remarked above, we get in particular 

H{x,Dxv{ti,x,uj),uj) < —a < for a.e. x E Br{y). 

By the definition of and the convexity oi H, we conclude that 

H{x, Dws{x,u>),uj) < —7H{x,Dxv{ti,x,u}),uj) 



2* 

+ ^^Hi^^^xv{ti,x,u}),uj) < <0 

for a.e. x G Br{y). This actually shows that We is strict since y was arbitrarily 
chosen in \ .4(w). □ 

Looking carefully at the above argument, we recognize that definition (j42p can 
be interpreted as a convenient way to select a 1-parameter family {f (i, •, ■)}i>o 
of elements in S in such a way that the following conditions are satisfied almost 
surely: v{-, -,00) is a subsolution of the time-dependent equation ([T5]); the function 
1 1-7> v{t,x,ijj) is constant on A{uj), and strictly increasing outside A{uj) in a suitable 
neighborhood [0,ta;) of t = 0; the map t >-)• v{t,x,u) is locally semiconcave (or 
semiconvex) in (0, +00), with a modulus that is locally uniform with respect to x. 

In the general case of an Hamiltonian, not strictly convex, but just convex, the 
latter condition is apparently no longer fulfilled by the random variable given by 
()42p .To get the proof of Theorem 13. 161 in full generality, we modify the definition of 
V by setting 

v{t,x,uj) = sup I {T-w){x,u}) - ^{s-tf\ ■ (46) 

To complete our task it is then enough to check out that such a v fulfills all the 
requirements listed above, and this is indeed the content of our next proposition. 
In this way v can be actually used in formula (143p to provide a strict subsolution 
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We & S almost surely satisfying (HH), while for the inequality ||t(;e — t(;||oo < £ in the 
item (i) of the statement, it simply suffices to choose r > and 6 > small enough. 

Proposition 3.22. Let v be defined via (|46|) for some w G S and 5 > 0. The 
following properties hold: 

(i) \\v{t^-,uj) — w{-,uj)\\oo < R{K){t + 25R{k)) for every t > Q and uj ^ Q.; 
(a) the function v{-, - ,0;) is a Lipschitz subsolution in (0, +oo) x of the time- 
dependent equation (llSp for every a; G fi; 
(Hi) v{t, •, •) £ S for every t > 0; 

(iv) for every uj in a set of probability 1 the following property holds: 

v{t,-,uj) = w{-,uj) on A{uj) for every t>0; 

(v) the functions {v{-,x,uj) : x G M^, uj GO.} are equi-semiconvex in (0,+oo). 

Moreover, if w (z S is weakly strict, then v enjoys the assertion of Proposition \3.19[ 

Proof. By Proposition 12.12] we know that the function {t,x) i— )■ {Tfw){x,uj) is 
i?(K)-Lipschitz continuous [0, +oo) x for every a; G $7, in particular (Tfw){x,uj) 
grows at most linearly in t. This implies that the supremum in ()46p is attained. Let 
us denote by Y{t,x,u}) the set of maximizers of the right-hand side term of ()46p . 
Then 

|s — t| < 25R{k) for every s G Y{t,x,uj). 
This follows from the fact that, for any such s, we have 

J_(i _ sf < {T-w){x,u;) - {Tiw){x,uj) < R{K)\t - s\. 

In particular, 

< v{t,x,oj) — {Tfw){x,u}) < {T~w){x,uj) — {Tfw){x,uj) < 26R{k)'^, 

and assertion (i) follows by Proposition 12. 121 - (^ii). 

Assertion (ii) is well known, see for instance [6j: the Lipschitz character of v{-, ■, cj) 
comes from the fact that it is the supremum of equi-Lipschitz functions; the subso- 
lution property is a consequence of the inclusion 

D^v{t, x,uj) C D^{T^w){x,uj) for every s G Y{t,x,uj), 

together with the fact that (Tfw){x,uj) is a (sub)solution of (fT5]) and that the 
Hamiltonian is autonomous. 

Let us prove item (Hi) for any fixed t > 0. First notice that, by continuity 
with respect to s, the supremum in ()i6]) can be taken over a dense and countable 
subset of (0,+oo), yielding that v(t,-,-) is a random variable. Moreover, v{t,-,uj) 
is the supremum of a family of critical subsolutions whenever u!{-,u}) is a critical 
subsolution, see Proposition 12.141 i.e. almost surely. This implies that v(t,-,uj) is 
a critical subsolution a.s. in cj. The fact that v{t, is almost surely sublinear is 
obvious from (i) and from the fact that w S. It is left to show that v{t,-,-) has 
stationary increments. Indeed, w has stationary increments, meaning that, for every 
fixed z G M^, there exists a random variable k{uj) and a set ilz with probability 1 
such that 

w{- + z,uj) = w{-,TzU)) + k{u!) on M"'^ for every a; G $7^. 

Keeping in mind the stationary character of the Lagrangian, it is easily checked that 
the same identity is satisfied by T~w for every s > 0, and, consequently, by v{t, •, •). 
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Assertion (iv) is straightforward consequence of the definition of v in view of 
Proposition 13.181 

Assertion (v) is also well known, see for instance [6]. 
Let us prove the last assertion. We first note that, when w{-,u}) is a critical subso- 
lution, the monotonicity of the map t i— > (T^w){x,uj) readily implies, by the very 
definition of v, that 

Y{t,x,Lo) C[t, +00). (47) 

Assume now that w is weakly strict and let us denote by a set of probability 1 
made up by elements uj for which w{-,u}) is a weakly strict critical subsolution. Fix 
Lo £ and pick a point x G M^\^(ct;). Then we know by (the proof of) Proposition 
I3.19l that there exists tx € (0, +00] such that the function 1 1— )• {Tfw){x,uj) is strictly 
increasing in [0,ta;) and constant for t > t^. In view of (I47p and the very definition 
of V, we infer that 

t I—)- v{t,x,u}) is constant for t > tx- 

It is left to show that it is strictly increasing in [0,tx)- Take ti > t2 in [0,ta;) and 
let Si € Y{ti,x,uj) for i = 1, 2. Two cases are possible: either S2 < tx or S2 = tx- In 
the first instance we have 

v{t2,X,U)) = {T~W){X,UJ) - ^{S2 -t2f 



< 

in the second 



(^ti + (s2-t2)^)(^''^) " is ^"^2 -*2)^ < v{ti,X,Uj), 



v{t2,X,Uj) = {T^^W){X,U}) - ^{tx -t2f 

< {Ti^w){x,uj) - Ysitx- tif < v{ti,x,uj), 
as it was to be shown. □ 



4. TONELLI HAMILTONIANS 

In this section we deal with Hamiltonians satisfying more stringent regularity 
assumptions and named after Tonelli. In the first subsection we provide basic defi- 
nitions and illustrate the salient features of the corresponding Hamiltonian flow and 
Lax-Oleinik semigroups. In the second one we prove existence of C^'^ strict sub- 
solutions in the stationary ergodic setting and investigate their properties. This is 
achieved by applying Bernard's method on C^'^-regularization of strict subsolutions 
on compact manifolds in the deterministic case. 

Throughout the section we will use the term semiconcave (respectively semicon- 
vex) in a stronger sense than the one defined in Section [2l we will in fact additionally 
require the modulus to be linear, namely Q{h) = Kh for some K > {). If such a 
constant need to be showcased then we will employ the diction ET-semiconcave (re- 
spectively, iiT-semiconvex) . We recall that a function u is both ET-semiconcave and 
if-semiconvex in some open subset U of if and only if is of class C^'^ in U and 
U^{Du;U) < K, see p]. 
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4.1. Generalities. We say that a stationary ergodic Hamiltonian H is Tonelli if it 
enjoys conditions (H1)-(H4) and the following set of assumptions: 
(Tl) H{-,-,uj) (£ C2(R^ X R^) for every a; G 

(T2) for every R > there exists a constant > such that 

-^{x,p,u}) > i^rM^n for every {x,p,uj) G x x 

(T3) for every i? > there exists Lr > such that 

\\DH{-,-,u)\\l^(^Nxb^) < Lr, 

Up{DH{;;i0);R'' xBr) < Lr 
for every a; G fi. 



Under above assumptions, it is well known that the associated Lagrangian is of 
class as well, see for instance [8l|T5], and satisfies properties analogous to (Tl)- 
(T3). 

Remark 4.1. The above hypotheses, in particular (T2) and (T3), are adaptation 
to the stationary ergodic environment of the usual ones required for deterministic 
Tonelli Hamiltonians. The changes are basically due to the fact that we need bounds 
independent of uj, and this immediately implies that they have also to be global in 
X. In fact, bounds independent of lo that are local in x simply do not make sense in 
our frame, for stationarity and ergodicity assumptions should automatically transfer 
them to the whole M^. Similarly, we could rephrase (T2) and (T3) by requiring ur 
and Lr to depend in a measurable way on uj: the ergodicity assumption would then 
imply that they are almost surely constant. 

We will denote by (j)^ {x,p,ijj) the Hamiltonian flow, i.e. the flow associated with 
Hamilton's ODE 

i= f(e,r/,a;) 

The corresponding integral curves will be also called characteristics in the sequel. 
As well known, H{(f>p {x,p,uj),u!) = H{x,p,u!) for every {x,p,u)), which yields, by 
the coercivity assumption (H3), that the flow is complete, i.e. globally defined in 
time. 

We proceed discussing the two main additional features of Lax-Oleinik semi- 
groups for Tonelli Hamiltonians, namely the fact that the action of semigroups is 
driven by characteristics and secondly that the functions obtained in this way are 
semiconcave/semiconvex. See [15] for corresponding proofs. 

Proposition 4.2. Let u be a d-Lipschitz random function, x G M.^ and t > 0. Let 

7 : [0, t] — >■ R^ be a Lipschitz curve with j{t) = x such that 

{Tfu){x,uj)=u{j{0),uj)+ / L(7,7,a;)ds. 

Jo 

Then 7 is the projection on the state variable space of a characteristic taking value 
(7(0)7^7(0)) '^^ time 0, and {x,px) at time t, where 

p^(0) G D~u{j{0),uj), px G D+{Tfu){x,uj). 
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While for continuous Hamiltonians, we can only assert K-Lipschitz continuity of 
{Tfu){-,uj) and {T^u){-,uj) when tt € 5, for Tonelli ones we get semiconcavity and 
semiconvexity, respectively. This property will be crucial to transfer to the stationary 
ergodic setting the regularization procedure yielding C^'^ critical subsolutions. 

Proposition 4.3. Let to > 0. Then the functions { ht{-, -,1^) : oj £ ^1, t > to} are 

locally equi-concave (and equi-Lipschitz) in X R^. In particular, there exists a 
constant K = K{tQ) such that, for every w S and for every t > tQ, 

(Tfw){-,uj) is K -semiconcave in , 
{T^w){-,uj) is K -semiconvex in M.^ , 

for every uj £ Q. 

Remark 4.4. The fact that the constants of local semiconcavity and semiconvexity 
are global in M.^ and independent of cj is a consequence of the fact that, for every 
i? > 0, the Lipschitz constant of DL{-, -^uj) on x Bji is finite and independent 
of uj. Condition (T2) is crucial to get such a bound, as it can be deduced from the 
known relation 

-(x,g,u.)=^— J {x,q,u:). 

We can derive from Theorem 13.121 

Theorem 4.5. The following facts hold: 

(i) for every v £ S, there exists a set O^, of probability 1 such that for every 
oj £VLy and every x E A{uj) 

v{-^oj) is differentiable at X and H{x, Dv{x)) = 0. 

(a) Let u and v belong to S. Then 

Du{-,uj) = Dv{-,iLi) on A{u}) 

for every € J7„ n $7^ . 

Theorem 14.51 is analogous to a well known result in weak KAM Theory and can 
be proved similarly, see [15]. 
Let us pick v £ S and set 

A{uj) := {{x, Dv{x, uj)) : x G A{uj) }, u; £ Q. 

Up to a set of null probability, the definition of A{uj) is independent of the choice of 
V £ S in view of Theorem 14.51 The following holds, see |15j : 

Theorem 4.6. There exists a set of probability 1 such that for every uj £0. 

(pH ("4(a;), w) = A{uj) for every t £R. 
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4.2. C ' subsolutions in stationary ergodic case. In this subsection we show 
how to pass from a strict critical and admissible subsolution, which is in general just 
Lipschitz-continuous with respect to x, to one which is of class C^'^ in R^. The 
precise result we will prove is the following: 

Theorem 4.7. Let H satisfy (H1)-(H4) and (T1)-(T3). Then there exists a strict 
critical subsolution in S of class C^'^ in M^. 

More precisely, for every strict critical subsolution w €z S and every e > 0, there 
exists a strict critical subsolution € S such that 

(i) \\we{--,u}) — w{-^uj)\\oo < £ for every bj ^ Q.; 

(ii) Ws{-,uj) = w{-,uj) on A{uj) a.s. inco; 
(Hi) vue{-,uj) G C^'^(]R^) for every lo £ il. 

This theorem, in particular, implies the existence of a critical admissible subsolu- 
tion of class C^'"^ and strict on the whole when the random Aubry set is almost 
surely empty. 

As a direct consequence of Theorem 14.71 and Corollary 13.171 we get 

Corollary 4.8. Let H satisfy (H1)-(H4) and (T1)-(T3). Then the set of admissi- 
ble, strict critical subsolutions of class C^'^ in is dense in S with respect to the 
Ky Fan metric on L°(0;C(M^)). 

We start by showing a further invariance property of Lax-Oleinik semigroup. 

Proposition 4.9. Let H be a stationary ergodic Tonelli Hamiltonian. Then the 
family of strict subsolution of S is invariant for the positive and negative Lax-Oleinik 
semigroups. Namely, ifu£S and is strict, then both T^u andTfu belong to S and 
are strict, for every t > 0. 

Proof. Let n S 5 be strict. Take uj such that u{-,u}) is a strict critical subsolution, 
u{-,uj) is differentiable on A{uj) and A{uj) is invariant with respect to the Hamiltonian 
flow. Theorems 14.51 and 14.61 guarantee that such a choice can be done in set of 
probability 1. 

We go on fixing t > and a closed ball B disjoint from A{uj). We consider the 
set V made up by points y optimal for {T^u){x,u}), for some x £ B. It inherits 
from B the property of being closed. As established in Proposition 14. 2^ if y G 1/ is 
optimal for (Tj~n)(x,a;), the corresponding Lagrangian minimizer 7 : [0,t] — )• is 
the projection on the state variable space of the characteristic taking the value {y,p) 
at time 0, with p S D~u{y,u). If y G A{uj), then p = Du{y,uj) and {y,p) G A{u), 
but then, by the invariance property of A{uj), 7 cannot reach x, which does not 
belong to A{uj). This argument shows by contradiction that V PI A{uj) = 0. 

Being u{-,uj) strict critical subsolution, there thus exists 5 > with 

H (y , Du(y , uj) , uj) < —5 for a.e. y G F. 

Taking into account that the Hamiltonian stays constant on characteristic, we derive 

H{x, Dx{Tfu){x,uj),uj) < —5 for a.e. x G B. 

Since i? is a closed ball arbitrarily chosen in the complement of A{uj), this proves 
the assertion for Tfu, and consequently for T^u in view of Remark 12.111 □ 

The same argument of the above proposition yields a strengthened form of Propo- 
sition [STH] for Tonelli Hamiltonians. Namely: 
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Corollary 4.10. Let H be a stationary ergodic Tonelli Hamiltonian. Then, for any 
weakly strict subsolution w & S, there exists a set of probability 1 such that, for 
every u G 0,^ and x G R-^ \ A{u), the function 

t I—)- (Tfw) (x, uj) 

is strictly increasing in [0, +oo). In particular, T^w is weakly strict for every t > 0. 

For the sake of completeness, we also provide, in the framework of the proof of 
Theorem I4.7| a worked out presentation of Bernard regularization technique in the 
deterministic setting using our terminology and notations. The material is illustrated 
in a more elementary way and providing more details with respect to the original 
proof in [1], at the expense of some loss of concision and elegance. 

The first two steps are purely deterministic, and so uj is omitted. Lemma 14.111 
establish that a function which is C^'^ locally around a given point, remains of class 
C^'^, at least in a smaller neighborhood of the same point, under application of 
for small times. It will be used in the subsequent Proposition 14.121 to show, 
by working on subtangents, that a function locally semiconvex becomes locally C^'^ 
under the same action. 

In what follows, the symbols vri and 112 will denote the projections on the space and 
momentum variable, respectively, i.e. the maps defined as 7ri(x,p) = x, 7r2(x,p) = p 
for every G x R^. 

Lemma 4.11. Assume if: : R^ — > R to 6e KQ-Lipschitz-continuous in , for some 
Ko > and, in addition, of class C^'^ in a neighborhood of Bi{xq), for some xq G R^. 
Then there exist to > and A> solely depending on kq and the Lipschitz constant 
of Dip in Bi{xo), such that, for every t G [0,to]) the following properties hold: 

(i) ify G Bii2{xq), then it is the unique point inM.^ that is optimal for {Tfip){x) 
with X = 7rio(/)f (y, D{ip{y)); 

(11) Tfi, G &'\By2{xo)) and Lip(D,(rrV); ^1/2(^0)) < A. 

Proof. For every t > 0, we define a map Rt : Bi{xo) R^ by setting 

Rt{y) = vrio(/)f (y, Dip{y)) for every y G 5i(xo). 

We claim that we can choose to > 0, only depending on kq and on the Lipschitz 
constant of Dip in i?i(xo), such that the map Rt — I is a contraction on Bi(xq) for 
every t G [0,to]- To this aim, fix yi and y2 in i?i(xo) and denote by {^i,r]i), i = 1,2, 
the characteristic taking the value {yi, Dip{yi)) at 0. We have 

Rtivi) -yi= ^te,??i)ds 
Jo 

and consequently 

KRtiyi) - yi) - {RM - y2)\ < [ 

Jo 

Now we recall that H is uniformly superlinear and locally bounded in p, uniformly 
in X, and stays constant on characteristics. From the inequality \Dip{yi)\ < kq we 
derive that , r]i{s)) is contained R^ x Bp for some p only depending on kq and 
on the functions a, /3 appearing in assumption (H3). Let us denote by £ the positive 
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^(6,^1) -^(6,^2) 



ds. (48) 



constant given by hypothesis (T3) with R := p. Resuming our estimate, from 
(pj) we get 

mtiVi) - Vi) - {RM - y2)\ < i f \{ii,rii) - (e2,r/2)|ds. 

JO 

Let us denote by A a Lipschitz constant for Dijj in Bi{xq). By Gronwall inequahty 

- {Us),ii2{s))\ < e''\{yi,Di;{yi))-{y2,D^{y2))\ (49) 
< e'' (\/l + A2) \yi - yal for s G [0,t], 

hence 

\{Rt{yi) - yi) - {Rt{y2) - y2)\ < (TT+A^) (e" - 1) \yi - yal- (50) 

Let us choose to > such that 

(e"o-l)Vl + A2<^, eto<^, toR{Ko)<^ 

and fix t G [0, to]- From (|50p we derive that Rt — I is a contraction, with Lipschitz 
constant less than 1/2. By the triangular inequality we get 

1 3 

-|yi - y2\ < \Rt{yi) - Rt{y2)\ < -\yi - y2\ for every yi, y2 G -Bi(xo), 

showing in particular that Rt is injective in Bi{xo). 
Let us prove (i). We first observe that the equality 

{Tfil)){x) = Tpiy) + ht{y,x) for x G 53/4(^0) 

implies y G Bi{xq) and Rt{y) = x, in view of Propositions 12.12] and in particular 
such a point y is unique by injectivity of Rt- On the other hand, by the choice of 
i and the inequality £t < 1/4, we easily see that the point x = Rt{y) belongs to 
-^3/4(^0) if y G -^1/2(2^0)1 in particular, as previously noticed, y is the unique point 
in that that is optimal for {Tf'ilj){x). 

Let us prove (ii). By the previous argument get that B^/4^{xq) C Rt{Bi{xQ)), so 
the map 

R;' : By2{xo) ^ B^ixo). 

is well defined and Lipschitz-continuous. From this and (j49p we infer that the 
function 

X ^ vrao^f (i?-i(x),Z)(^(i?,-i(x)))) 

is A-Lipschitz continuous in Bi/2ixo), where A is a constant only depending on to 
and on the Lipschitz constant of Dip in Bi{xq). In addition, by Proposition 14.21 its 
images belong, for any x, to {Tfip){x). This means that we have constructed an 
^-Lipschitz continuous selection of [T^ ip){x) in i?x/2(^o)- Now T^ip is semicon- 
cave, hence by exploiting basic properties of superdifferential of semiconcave func- 
tions we conclude that T^il^ G C^'^(Si/2(xo)) and U-p{D^{T^ Bi/2{xo)) < A. □ 

Proposition 4.12. Let w be a critical subsolution which is K -semiconvex in Bi{xq) 
for some xq G M^. Then we can find to > 0, only depending on K , such that 

Tfw G Ci'i(5i/4(xo)) for any t G (0,to]. 

Moreover, hip(^Dx{Tf w); Bi/4^{xq)) < Bt for some Bt only depending on t and K. 
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Proof. By semiconvexity assumption on w we have that, for any y S Bi{xo) and 
p G D^w{y), the paraboloid 

ipy,p{x) = w{y) + {p,x - y) - K\x - yp, x G Bi{xq) 

is a subtangent in Bi{xq) to w ai y. We suitably extend it outside Bi{xq) to obtain 
a family of KQ-Lipschitz continuous subtangents to w in M^, i.e. satisfying ip < w 
m R^, which are in addition C°° and possess JC~Lipschitz differentials in Bi{xo). 
Here kq is a constant greater than or equal to k. We denote by F this family of 
modified paraboloids. 

We are then in the framework of Lemma 14.111 and consequently there exist two 
common values to > and A > such that, for every t G [0,to]) all functions of F 
satisfy items (i) and (ii) of the lemma. Up to choose a smaller to if necessary, we 
can also assume 

toR{Ko)<^. (51) 
Let us fix t G [0, to]- We want to show that 

{Tfw){x) = sup(Tf7p){x) for every x G Bi/4^{xq). (52) 

By monotonicity of Tf, it is clear that Tfw > sup^^pTfip on R^. Let us show 
equality on i?i/4(xo). Fix x G i?i/4(xo) and let y G be optimal for {Tfw){x). 
Then y G Bi/2{xo) in view of Proposition 12.121 and of (fSTI) . By Proposition 14. 2^ 
there furthermore exists p G D^w{y) such that 

X = 7rio(/>f (y,p). 

By the very definition of F, there is ip ^ F which is a subtangent to w at y and 
satisfies Dip{y) = p. Hence, by Lemma [4.1 11 - (^z). y is also optimal for {Tfip){x), so 
that 

{Tiw){x) = (rr^)(x), 

proving ([52]) . 

Summing up, we have showed that T^w is the supremum in Bi/4^{xo) of a family 
of ^-semiconvex functions, so it is A-semiconvex. Now T^w is also ETf-semiconcave 
for some Kt only depending on t, in view of Proposition 14.31 We conclude that Tfw 
is of class C^'^ in Bi/4^{xq) with Lip (^D^iTf w); Bi/4^{xq)) < Bt := max{j4,Kt}. □ 

We go back to stationary ergodic setting and apply to it the information on the 
action of Lax-Oleinik semigroups gathered in the two previous deterministic results 
as well as other distinguished outputs of the analysis so far performed. 

Proof of Theorem 14.71 Let w G 5 be a strict subsolution and let e > be fixed. 
Choose s > such that R{k)s < e/2 and set 

v{x,uj) = {T^w){x,uj), {x,uj) G X J^. 

According to Proposition 14.9] v is still an admissible and strict critical subsolu- 
tion. Furthermore, by Proposition 14.31 there exists K > such that v{-,lj) is 
IC-semiconvex in M.^ for every uj £ Q. In view of Proposition 14.121 there exist t > 
and a constant Kt, only depending on t, such that Tfv{-,uj) is a function of class 
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C^'^ in and Lip(^Dx{Tf- v(-,a;));M^) < Kt, for every a; € $1. Since t can be taken 
arbitrarily small, we choose t > such that R{n)t < e/2 and we set 

w^{x,uj) = {Tfv){x,uj) = {TfoT^w){x,u}), {x,u>) € x Q. 

According to Proposition l4.91 is still an admissible and strict critical subsolution. 
From Proposition 12.121 we get 

\\we{-,uj) - w{-,uj)\\oo < \\TfoT^w{-,uj) - w{- , uj)\\oo + \\T^w{-,uj) - u;(-,a;)||oo 

< (t + s)R{k) < e. 

Last, by Proposition 13. 18l for every uj in a set of probability 1 we have 

Wi;{-,uj) = TfoT^w{-,uj) = T^w{-,uj) = w{-,u!) on A{uj). 

□ 
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